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(54) Creating! reverberation by estimation of impulse response 



(57) A first acquisition section acquires space infor- 
mation indicating a spatial shape of the acoustic space 
and an acoustic reflectivity of a boundary surface en- 
closingthe acoustic space. Aseeond acquisition section 
acquires point information indicating positions of a 
sound generation point and a sound reception point set 
in the acoustic space. An estimation section estimates 
a set of acoustic ray paths of the sound traveling from 
the sound generation point to the sound reception point 
based on the acquired space information and the point 



information. A third acquisition section acquires direc- ' 
tivity information indicating an acoustic directivity of the 
sound generation point and the sound reception point. 
A weighting section estimates ah acoustic intensity of 
each acoustic fay path, and weights each acoustic In- 
tensity by the acquired directivity Information. A deter- 
mination section determines the impulse response 
based on directions of the respective acoustic ray paths 
toward the sound reception point and the weighed 
acoustic intensities of the respective acoustic ray paths. 
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Description 

BACKGROUND OF THE INVENTION 

[TECHNICAL FIELD OF THE INVENTION] 

[0001] The present invention relates to a reverbera- 
tion applying apparatus, a reverberation applying meth- 
od, an impulse response generation apparatus, an im- 
pulse response generation method, a reverberation ap- 
plying program, an impulse response generation pro- 
gram, and a recording medium for applying a reverber- 
ation effect to an audio signal in orderto reproduce mu- 
sical performances and the like held in acoustic spaces 
such as an auditorium a concert hall, a theater, and the 
like. 

[PRIOR ART] 

[0002] In recent years, various technologies are pro- 
posed so that a user cap listen to realistic music in his 
or her room (hereafter referred to as a listening room) 
at home as if he or she were enjoying live performance 
in a concert hall or theater. One example is the acoustic 
field reproduction technology that reproduces acoustic 
fields of a virtual acoustic space such as apublic concert 
hall in an actual acoustic space such as a private listen- 
ing room. 

[0003] The acoustic field reproduction technology will, 
now be described. FIG. 11 schematically shows how 
sounds are reflected in an acoustic space 90 when a 
sound generation point S such as a musical instrument 
generates a sound. As shown in FIG. 11, sounds gen- 
erated from the sound generation point S on a stage 901 
are reflected on boundary surfaces such as a ceiling and 
side walls in the acoustic space 90 and reach an audi- 
torium 902. The reflected sounds reach the auditorium 
902 not simultaneously, but with time delays dependent- 
ly on diverse travel distances. 

[0004] In FIG. 11 , a listening room L is depicted in the 
auditorium 902. If acoustics of a direct sound or a re- 
flected sound (i.e., reverberant sound) can be repro- 
duced on boundary surfaces such as a ceiling and walls 
in the listening room L, the listening room L can repro- 
duce the acoustic field of the auditorium 902 enclosed 
in the listening room L. Generally, the reproduction of 
acoustics uses a reverberation applying apparatus that 
performs a convolution operation for an audio signal and 
an impulse response in the acoustic space for output, 
the impulse response is derived by using an acoustic 
signal containing reverberant sounds collected in the lis- 
tening room L when the sound generation point S having 
nondirectional characteristics generates an acoustic 
measurement signal such as an impulse sound. 
[0005] The conventional reverberation applying ap- 
paratus does not always accurately reproduce acoustic 
fields in the acoustic space. For example, it is impossible 
to reproduce an acoustic field in which the performer 



plays a musical instrument having specific directivity 
such as a brass instrument. 

SUMMARY OF THE INVENTION 

5 

[0006] The present invention has been made in con- > 
sideration of the foregoing. It is therefore an object of 
the present invention to provide a reverberation apply- 
ing apparatus, a reverberation applying method, an im- 

io pulse response generation apparatus, an impulse re- 
sponse generation method, a reverberation applying 
program, an impulse response generation program, and 
a recording medium capable of more accurately repro- 
ducing acoustic fields in an acoustic space. 

15 [6007] In order to achieve the above-mentioned ob- 
ject, the present invention provides a reverberation ap- 
plying apparatus for applying a reverberation effect to 
an audio signal for reproduction of a sound in a desired 
acoustic space. The inventive apparatus comprises a 

20 space information acquisition means fro acquiring 
space information indicating a spatial shape of the^ 
acoustic space bordered by a boundary surface and an 
acoustic reflectivity of the boundary surface enclosing 
the acoustic space, a point Information acquisition 

25 means for acquiring point information indicating posi- 
tions of a sound generation point set in the acoustic 
space as a point of generating the sound, and a sound 
reception point set in the acoustic space as a point of 
receiving the sound, an acoustic ray path estimation 

30 means for estimating a set of acoustic ray paths of the 
sound traveling from the sound generation point to the 
sound reception pointthrough the acoustic space based 
on the acquired space information and the point Infor- 
mation, a directivity information acquisition means for ., 

35 acquiring directivity information indicating either of an ' 
acoustic generation directivity characterizing a directiv- 
ity of the sound generation point in generating the 
sound, and an acoustic reception directivity character- 
izing a directivity of the sound reception point in receiv- 

40' ing the sound, a weighting means for estimating each 
acoustic intensity of the sound around the sound recep- 
tion point for each of the acoustic ray paths through 
which the sound travels to the sound reception point 
from the sound generation point, and forweighting each 

45 acoustic intensity by the acquired directivity information, 
an impulse response determination means for determin- 
ing an impulse response of the acoustic space based 
on directions of the respective acoustic ray paths toward 
the sound reception point and the weighed acoustic in- 

50 tensities of the respective acoustic ray paths, and a con- 
volution operation means for performing a convolution 
operation between the determined impulse response 
and the audio signal to apply thereto the reverberation 
effect specific to the acoustic space. 

55 [0008] Underthis configuration, the weighting means 
specifies a sound intensity at the sound reception point 
for each acoustic ray path specified by the acoustic ray 
path specification means. The weighting means weights 
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the specified sound intensity in accordance with sound 
generation, directivity of the sound generation point and 
sound reception directivity of the sound reception point. 
The impulse response specification means specifies an 
Impulse response of the acoustic space according to a 
direction toward the sound reception point along each 
acoustic ray path and the weighted sound intensity. The 
convolution operation means performs a convolution 
operation between the specified impulse response and 
the audio signal. 

[0009] In this manner, the reverberation applying ap- 
paratus according to the present invention specifies an 
impulse response corresponding to directivity of the 
sound generation point and the sound reception point. 
The convolution operation is performed between the im- 
pulse response and the audio signal. The audio signal 
acquired as a result of the convolution operation is sup- 
plied with a reverberant sound corresponding to the di- 
rectivity of the sound generation point and the sound re- 
ception point. Even if a musical sound is reproduced 
from a musical instrument having directivity such as 
brass instruments, it is possible to reproduce an acous- 
tic field reflecting the directivity and more accurately re- 
produce the acoustic field. 

[0010] The above-mentioned reverberation applying 
apparatus may be provided with a storage means for 
previously storing an audio signal to be supplied with 
the acoustic effect. Further, there may be provided with 
a reception means for receiving the audio signal from 
an external apparatus via networks such as the Internet. 
[0011] The above-mentioned reverberation applying 
apparatus may be configured so that either the sound 
generation point S or the sound reception point R pro- 
vides uniform directivity, I.e., nondirectional character- 
istics. It may be preferable to use only the directional 
directivity for weighting. 

[0012] In order to achieve the above-mentioned ob- 
ject, the present invention provides an impulse re- 
sponse generation apparatus capable of determining an 
impulse response for use in reproduction of a sound in 
a desired acoustic space. The inventive apparatus com- 
prises a space information acquisition means for acquir- 
ing space information indicating a spatial shape of the 
acoustic space bordered by a boundary surface and an 
acoustic reflectivity of the boundary surface enclosing 
the acoustic space, a point information acquisition 
means for acquiring point information indicating posi- 
tions of a sound generation point set in the acoustic 
space as a point of generating the sound, and a sound 
reception point set in the acoustic space as a point of 
receiving the sound, an acoustic ray path estimation 
means for estimating a set of acoustic ray paths of the 
sound traveling from the sound generation point to the 
sound reception point through the acoustic space based 
on the acquired space information and the point infor- 
mation, a directivity information acquisition means for 
acquiring directivity information Indicating either of an 
acoustic generation directivity characterizing a directiv- 



ity of the sound generation point in generating the 
sound, and an acoustic reception directivity character- 
izing a directivity of the sound reception point in receiv- 
ing the sound, a weighting means for estimating each 

s acoustic Intensity of the sound around the sound recep- 
tion point for each of the acoustic ray paths through 
which the sound travels to the sound reception point 
from the sound generation point, and forweighting each 
acoustic intensity by the acquired directivity information, 

io and an impulse response determination means for de- 
termining an impulse response of the acoustic space 
based on directions of the respective acoustic ray paths 
toward the sound reception point and the weighed 
acoustic intensities of the respective acoustic ray paths. 

'5 [0013] Underthis configuration, the weighting means 
specifies a sound intensity at the sound reception point 
for each acoustic ray path specified by the acoustic ray 
path specification means. The weighting means weights 
the specified sound intensity in accordance with sound 

?o generation directivity of the sound generation point and 
sound reception directivity of the sound reception point 
The impulse response specification means generates 
and outputs an impulse response of the acoustic space 
according to a direction toward the sound reception 

25 point along each acoustic ray path and the weighted 
sound intensity. 
. [0014] Consequently, the impulse response genera- 
tion apparatus according to the present invention gen- 
erates and outputs an impulse response in accordance 

30 with directivity of each of the sound generation point and 
the sound reception point. The impulse response is 
used for the reverberation applying apparatus that sup- 
plies reverberation In accordance with the Impulse re- 
sponse. 

35 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0015] 

*o FIG. 1 schematically shows aform of using a rever- 
beration applying apparatus according to an em- 
bodiment of the present invention; 
FIG. 2 is a block diagram showing an electrical con- 
figuration of the reverberation applying apparatus; 

fs FIG. 3 is a flowchart showing a process executed 
by a CPU according to the embodiment of the 
present invention; 

FIG. 4 schematically shows a configuration of a rec- 
ipe file according to the embodiment of the present 

~>o invention; 

FIG. 5 schematically shows acoustic ray paths ac- 
cording to the embodiment of the present invention; 
FIG. 6 schematically shows a configuration of an 
acoustic ray path information table according to the 

> 5 embodiment of the present invention; 

FIG. 7 is a flowchart showing an impulse response 
. calculation process executed by the CPU according 
to the embodiment of the present invention; 
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FIG, 8 schematically shows a configuration of a 
composite sound ray vector table according to the 
embodiment of the present invention; 
FIG. 9 explains reproduction channel information 
according to the embodiment of the present inven- 
tion; 

FIG. 10 schematically shows a convolution opera- 
tion processing block according to the embodiment 
of the present invention; and 
FIG. 11 illustrates a conventional acoustic field re- 
production technique. 

DETAILED DESCRIPTION OF THE INVENTION 

[0016] Embodiments of the present invention will be 
described in further detail with reference to the accom- 
panying drawings. 

[0017] FIG. 1 shows a form of using a reverberation 
applying apparatus 10 according to an embodiment of 
the present invention. In order to reproduce an acoustic 
field of the acoustic space, the reverberation applying 
apparatus 1 0 uses four reproduction channels to repro- 
duce the sound reaching a listener U from four directions 
in the acoustic space. As shown in FIG. 1 , the reverber- 
ation applying apparatus 1 0 is provided with four repro- 
duction channel terminals Tch1 to Tch4. Each of the re- 
production channel terminals Tch1 to Tch4 connects 
with each of four speakers 4 having almost the same 
performance. The four speakers 4 each are arranged 
with almost the same distance from the listener U. The 
description below uses the reference numerals 4-FR, 
4-FL, 4-BR, and 4-BL to distinguish the speakers 4 from 
each other. 

[0018] The reproduction channel terminal Tch1 con- 
nects with the speaker 4-FR that is arranged at the right 
front of the listener U (left front in the figure). The repro- 
duction channel terminal Tch2 connects with the speak- 
er 4-FL that is arranged at the left front of the listener U 
(right front in the figure). The speakers 4-FR and 4-FL 
generate sound reaching the listener U from the front in 
the acoustic space to be reproduced by the reverbera- 
tion applying apparatus 10. 

[0019] The reproduction channel terminal Tch3 con- 
nects with the speaker 4-BR that is arranged at the right 
rear of the listener U (left rear in the figure). The repro- 
duction channel terminal Tch4 connects with the speak- 
er 4-BL that is arranged at the left rear of the listener U 
(right rear in the figure). The speakers 4-BR and 4-BL 
generate sound reaching the listener U from the rear in 
the acoustic space to be reproduced by the reverbera- 
tion applying apparatus 10. 

[0020] FIG. 2 shows an electrical configuration of the 
reverberation applying apparatus 10. 
[0021] In FIG. 2, a CPU (Central Processing Unit) 102 
controls operations of each section via a data address 
bus 100. ROM (Read Only Memory) 104 is rewritable 
nonvolatile memory such as EEPROM (Electrically 
Erasable Programmable ROM) and stores control pro- 



grams executed by the CPU 1 02, programs for various 
processes, and various data. RAM (Random Access 
Memory) 1 06 is volatile memory and is used as a work 
area for the CPU 1 02 to temporarily store various oper- 

5 atlon results and data. A storage device 1 08 comprises 
storage media such as a hard disk, magnetic disk, mag- 
netic optical disk, and optical disk, and stores the follow- 
ing data: reproduction acoustic space data, sound gen- 
eration point data, and sound reception point data. 

10 [0022] The reproduction acoustic space data is pro- 
vided for each acoustic space such as a concert hall, a 
church, or a theater. One piece of reproduction acoustic 
space data contains space shape information and re- 
flectivity. The space shape information indicates an 

15 acoustic space shape and is represented by coordinate 
information of the XYZ orthogonal coordinate system in- 
dicative of arrangement positions of a wall, ceiling, and 
floor. The reflectivity indicates sound reflectivity (ab- 
sorption coefficient, sound reflection angle, etc.) of wall, 

20 ceiling, and floor materials in the acoustic space. 

[0023] The sound generation point data is provided 
for a possible sound generation point S such as a piano, 
trumpet, and clarinet. One piece of sound generation 
point data contains directivity at the sound generation 

25 point S. The directivity at the sound generation point S 
indicates a sound generation intensity atthe sound.gen- 
eration point'S in each direction with respect to the' 
sound generation points. The sound reception point da- 
ta is provided for each possible sound reception point R 

30 such as a human being and a microphone. One piece 
of sound reception point data contains directivity.at the 
sound reception point R. The directivity at the sound re- 
ception point R indicates sound reception sensitivity at 
the sound reception point R In each direction with re- 

35 spect to the sound reception point R. . 

[0024] The storage device 1 08 stores a large amount 
of reproduction acoustic space data, sound generation 
point data, and sound reception point data so that a user 
can select an acoustic space or a musical instrument to 

40 be performed from several candidates. The storage de- 
Vice 108 may not be included in the reverberation ap- 
plying apparatus 1 0, but may be an external storage de- 
vice. The reverberation applying apparatus 1 0 need not 
always have the storage device 1 08. A networked serv- 

45 er may be provided with the storage device 108. The 
reverberation applying apparatus 1 0 may be configured 
to have a communication means. Through the use of 
the communication means, it may be preferable to ac- 
quire various data stored in the storage device 1 08 from 

so the server via the network. 

[0025] In FIG. 2, a display device 110 corresponds to, 
e.g., a CRT (Cathode Ray Tube) display and displays 
various information under control of the CPU 102. More 
specifically, the display device 1 1 0 displays candidates 

55 for the acoustic space, sound generation point S, and 
sound reception point R. Further, the display device 110 
displays a perspective.view indicating a shape of the us- 
er-selected acoustic space. 



EP 1 357 536 A2 



[0026] An input device 112 corresponds to, e.g., a 
keyboard, a mouse, and a joystick, and outputs various 
. user-input information to the CPU 102 via the data ad- 
dress bus 100. The user-input information includes not 
only a user-selected acoustic space and types of the 
sound generation point S, but also arrangement posi- 
tions (coordinate information) for each of the sound gen- 
eration point S and the sound reception point R in the 
acoustic space, directions of the sound generation point 
S and the sound reception point R, and the like. In more 
detail, when a user operates the input device 1 1 2 to se- 
lect an acoustic space from several candidates, the in- 
put device 112 detects this operation and supplies the 
CPU 102 with selection information about the selected 
acoustic space. When receiving the selection informa- : 
tion about the user-selected acoustic space, the CPU 
102 reads reproduction acoustic space data corre- 
sponding to this acoustic space from the storage device 
108, and then allows the display device 110 to display 
a perspective view indicating a shape of the acoustic 
space. Namely, the inventive reverberation applying ap- 
paratus has a storage device that stores a plurality of 
the space information representing a plurality of acous- 
tic spaces of different types, and an input device that 
can be operated by a user to select a desired one of the 
acoustic spaces. Thus, the space information acquisi- 
tion means retrieves the space information correspond- 
ing to the selected acoustic space from the storage de- 
vice. 

[0027] For example, the user operates the input de- 
vice 1 1 2 to specify arrangement positions and directions 
of the sound generation point S and the sound reception 
point R In the perspective view displayed in the display 
device 110. At this time, the input device 112 detects 
such operation to provide the CPU 102 with coordinate 
information about each XYZ orthogonal coordinate sys- 
tem indicative of the arrangement positions and direc- . 
tions of the sound generation point S and the sound re- 
ception point R. 

[0028] The CPU 1 02 calculates an impulse response 
in the acoustic space for each reproduction channel 
based on the reproduction acoustic space data, and the 
type, position, and direction of each of the sound gen- 
eration point S and the sound reception point R. A pro- 
cedure of calculating the impulse response will be de- 
scribed later in more detail. 

[0029] An A/D converter 1 1 4 is supplied with an ana- 
log audio signal to be provided with an acoustic effect.. 
The A/D converter 114 then converts the input analog 
audio signal into a digital audio signal. In order to pre- 
vent an unnecessary reverberant sound from being in- 
cluded during reproduction, it is preferablethat the audio 
signal be that of a musical sound or a speech recorded 
in a dead space such as an unechoic chamber (i.e., dry 
source). 

[0030] The storage device 1 08 may previously store 
waveform data for an audio signal to be provided with 
the acoustic effect. The reverberation applying appara- 



tus 10 may further comprise a communication appara- 
tus for interchanging data via the network. It may be 
preferable to receive waveform data forthe audio signal 
from external apparatuses such as networked servers 
5 >■ via the communication apparatus and provide the re- 
ceived waveform data with the acoustic effect. 
[0031 ] The reverberation-applying apparatus 1 0 com- 
prises a convolution device 116-1 to 116-4, a DSP 118-1 
to 118-4, and a D/A converter 120-1 to 120-4 for each 
™ reproduction channel in order to provide audio signals 
with differentreverberationeffectsforeach reproduction 
channel and reproduce the audio signals. The convolu- 
tion device 116-1 realtime performs the real-time con- 
volution for an impulse response to this apparatus from 
is the CPU 1 02 and the digital signal from the A/D convert- 
er 1 1 4 and outputs a result to the DSP 1 1 8-1 via the data 
address bus 100. The convolution device may not be 
configured as the hardware, but may use a program to 
provide the CPU 102 with a function equivalent to the 
20 convolution device. 

[0032] The DSP 118-1 processes the digital signal re- 
ceived from the convolution device 1 1 6-1 by performing 
various signal processes such as signal amplification, 
time delay, and frequency filtering and outputs the proe- 
ms essed signal to the D/A converter via the data address 
bus 100. 

[0033] The D/A converter 120-1 converts the digital 
signal received from the DSP 118-1 into an analog sig- 
nal and outputs this signal to the speaker 4-FR connect- 
so ed to the reproduction channel terminalTchl. The same 
applies to convolution devices 116-2 through 116-4, 
DSPs 118-2 through 11 8-4,. and D/A converters 120-2 
through 120-4 provided correspondingly to the other re- 
production channels. While one convolution device and 
35 one DSP are provided for each reproduction channel, 
the present invention is not limited thereto. It 'may be 
preferable to configure one convolution device and one 
. DSP to process audio signals for each reproduction 
channel. Further, it may be used multi-tap delay unit 
4" generally known in the art as the convolution devices 
116-1 to 116-4. ' 

[0034] In this configuration, the reverberation apply- 
ing apparatus 1 0 provides the audio signal with a rever- 
beration effect of the user-selected acoustic space and 

45 executes a process for reproducing the audio signal in 
accordance with a program stored in the ROM 1 04. This 
program is recorded on a computer-readable recording 
medium such as an optical disk, magnetic disk, and 
magnetic optical disk and is installed therefrom. The re- 

so verberation applying apparatus 1 0 may receive the pro- 
gram via the network. Namely, the inventive computer 
program is provided for use in a reverberation applying 
apparatus having a CPU. The program is executable by 
the CPU for causing the reverberation applying appara- 

55 tus to perform a method of applying a reverberation ef- 
fect to an audio signal for reproduction of a sound in a 
desired acoustic space. The method includes a first step 
of acquiring space information and point information, the 
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space information indicating a spatial shape of the 
acoustic space bordered by a boundary surface and an 
acoustic reflectivity of the boundary surface enclosing 
the acoustic space, the point information indicating po- 
sitions of a sound generation point set in the acoustic 
space as a point of generating the sound and a sound 
reception point set in the acoustic space as a point of 
receiving the sound, a second step of estimating a set 
of acoustic ray paths of the sound traveling from the 
sound generation point to the sound reception point 
through the acoustic space based on the acquired 
space information and the point information, a third step 
of acquiring directivity inf ormation indicating either of an 
acoustic generation directivity characterizing a directiv- 
ity of the sound generation point in generating the 
sound, and an acoustic reception directivity character- 
izing a directivity of the sound reception point in receiv- 
ing the sound, a fourth step of estimating each acoustic 
intensity of the sound around the sound reception point 
for each of the acoustic ray paths through which the 
sound travels to the sound reception point from the 
sound generation point, and weighting each acoustic in- 
tensity by the acquired directivity information, a fifth step 
of determining an impulse response of the acoustic 
space based on directions of the respective acoustic ray 
paths toward the sound reception point and the weighed 
acoustic intensities of the respective acoustic ray paths, 
and a sixth step of performing a convolution operation 
between the determined impulse response and the au- 
dio signal to apply thereto the reverberation effect spe- 
cific to the acoustic space. 

[0035] . FIG. 3 is a flowchart showing an operational 
procedure of the reverberation applying apparatus 10. 
As shown in FIG. 3, the CPU 102 acquires pieces of 
information such as the user-selected acoustic space, 
the type of the sound generation point S, the arrange- 
ment position of the sound generation point S, the di- 
rection of the sound generation point S, the type of the 
sound reception point R, the arrangement position of the 
sound reception point R, and the direction of the sound 
reception point R from the input device 112 via the data 
address bus 100 (step S1). The CPU 102 then gener- 
ates a recipe file RF (see FIG. 4) recording these pieces 
of information in the RAM 106 (step S2). 
[0036] The CPU 1 02 then reads reproduction acous- 
tic space data corresponding to the acoustic space re- 
corded in the recipe file RF from the storage device 1 08 
(step S3). The CPU 1 02 estimates an acoustic ray path 
traveled by a sound ray generated from the sound gen- 
eration point S up to the sound reception point R (step 
S4) based on the space shape indicated by the repro- 
duction acoustic space data and arrangement positions 
of the sound generation points and the sound reception 
point R recorded in the recipe file RF according to the 
so-called ray tracing method that traces a path traveled 
by the sound generated from the sound generation point 
S. More specifically, the CPU 1 02 estimates an acoustic 
ray path assuming that the sound generation point S has 



. nondirectional ray characteristics. The sound genera- 
tion point S generates almost the same number of 
sounds in all directions. Some of these sounds reflect 
against the walls and the ceiling in the acoustic space 

s and reach the sound reception point R. Paths of these 
sounds are estimated (see FIG. 5). 
[0037] After estimating the acoustic ray paths, the 
CPU 1 02 sequentially generates records of acoustic ray 
paths from the shortest acoustic ray path length to cre- 

10 ate an acoustic ray path information table TBL1 (step 
S5). 

[0038] FIG, 6 schematically shows a configuration of 
the acoustic ray path information table TBL1 . As shown 
in FIG. 6, the acoustic ray path information table TBL1 
15 contains a record generated for each estimated acoustic 
ray path. One record includes the acoustic ray path 
length, the generation direction, the reflection fre- 
quence, and the reflection attenuation rate Here, the 
acoustic ray path length represents the length of an 
20 acoustic ray path. 

[0039] The generation direction indicates the direc- 
tion of a sound generated from the sound generation 
point S and is represented by a vector in the XYZ or- 
thogonal coordinate system. The arrival, direction indi- 
25 cates the direction of a sound arriving at the sound re- 
ception point R and is represented by a vector in the 
same manner as the generation direction. The reflection 
frequence indicates the number of times the sound is 
reflected along its acoustic ray path against the walls, 
so the ceiling, and the like in the acoustic space. The re- 
flection attenuation rate denotes an attenuation factor 
of the sound due to a plurality of reflections indicated by 
the reflection frequence. 

[0040] The CPU 1 02 then executes a process for cal- 

35 culating an impulse response (step S6). 

[0041] FIG. 7 is a flowchart showing an impulse re- 
sponse calculation process executed by the CPU 102. 
Here, the impulse response calculation uses frequency- 
dependent parameters such as directivity of the sound 

40 generation point S. The CPU 102 divides a frequency 
band for the impulse response into bands causing an 
approximately constant parameter value and executes 
a process for calculating the impulse response for each 
band. The embodiment assumes that the frequency 

45 band for impulse responses is divided into M bands. 
[0042] The CPU 1 02 first initializes a variable m for 
specifying the band to "1" (step U1). The CPU 1 02 then 
executes the following process to trace the acoustic ray 
path for each acoustic ray path and to find a sound ray 

so intensity I of thesoundthat matches thesound reception 
point R. 

More specifically, the CPU 102 retrieves the first record 
from the acoustic ray path information table TBL1 (step 
U2). The CPU 102 then finds the sound ray intensity I 
55 for each acoustic ray path in a band fm according to the 
following equation (step U3) from the generation direc- 
tion, the reflection attenuation rate, and the directivity 
indicated in the sound generation point data corre- 
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sponding to the sound generation point S. 

I - (r A ?/L A 2) x a(fm) 
x d(fm, X, Y, Z) x p(fm, L) 

where r is the reference distance, L the acoustic 
ray path length, a(fm). the reflection attenuation rate, d 
(fm, X, Y, Z) the sounding directivity attenuation coeffi- 
cient, and p(fm, L) the distance attenuation coefficient. 
The reference distance r Is determined in accordance 
with the size of the acoustic space to be reproduced. 
More specifically, when the acoustic ray path length is 
sufficiently large with reference to the acoustic space 
size, the reference distance r is determined so as to in- 
crease the attenuation amount of the sound that travels 
the acousticray path. An operator ,IA " in the above-men- 
tioned equation represents the power. 
[0043] The reflection attenuation rate <x(fm) is a sound 
decrement in accordance with the number of sound re- 
flections against walls or the like in the acoustic space 
as mentioned above. Since the sound reflectance de- 
pends on the frequency of the sound to be reflected, the 
reflection attenuation rate is determined on a band ba- 
.sis. 

[0044] The sounding directivity attenuation coefficient 
d(fm, X, Y, Z) is an attenuation coefficient in accordance 
with the directivity and the direction of the sound gener- 
ation point S. In more detail, the sound generation point 
S contains the directivity of generating sounds with dif- 
ferent intensities in respective directions. The directivity 
varies with a band of the sound to be generated. Ac- 
cordingly, the CPU 102 corrects the directivity of the 
sound generation point S based on the direction of the 
sound generation point S to find the sounding directivity 
attenuation coefficient d(fm, X, Y, Z). The CPU 102 
weights the value of the.sounding directivity attenuation 
coefficient d(fm, X, Y, Z) corresponding to the direction 
from the sound generation point S with the sound ray 
intensity I to find the sound ray intensity I for each acous- 
tic ray path corresponding to the directivity and the di- 
rection of the sound generation point S. 
[0045] The distance attenuation coefficient P(fm, L) 
represents an attenuation for each band corresponding 
to the sound travel distance (path length); 
[0046] The CPU 1 02 then determines whether or not 
the record processed at step U3 is the last record (step 
U4). If the result is "NO", the CPU 102 retrieves the next 
record from the acoustic ray path information table TBL1 
(step U5) and returns the process to step U3 to find the 
sound ray intensity I for an acoustic ray path stored in 
this record. 

[0047] If the result at step U4 is "YES", the CPU 1 02 
extracts acoustic ray paths causing the same time inter- 
val for arrival at the sound reception point R (i.e., rever- 
beration delay time). The CPU 102 then finds a com- 
posite sound ray vector of each acoustic ray path at the 



sound reception point R from an arrival direction vector 
and the sound ray intensity I of the acoustic ray path. 
More specifically, if the acoustic ray paths have acoustic 
ray path lengths equal to each other, the same time in- 

5 terval Is needed for sounds to travel the corresponding 
acoustic ray paths to reach the sound reception point R. 
Hence, the CPU 1 02 extracts records having the same 
acoustic ray path length from the acoustic ray path in- 
formation table TBL1 and finds a composite sound ray 

io vectorfrom the arrival direction and the sound ray inten- 
sity contained in each record. 

[0048] The CPU 1 02 then creates a composite sound 
ray vectortableTBL2from the composite sound ray vec- 
tor found at step U6 (step U7). 

«■ [0049] FIG. 8 schematically shows a configuration of 
the composite sound ray vector table TBL2: 
[0050] As shown in FIG. 8, the.composite sound ray 
vector table TBL2 contains a record for each composite 
sound ray vector found at step U6. One record compris- 

2P es a reverberation delay time, a composite sound ray 
intensity Ic, and a composite arrival direction. 
[0051] The reverberation delay time indicates a time 
interval required for the sound indicated by the compos- 
ite sound ray vector to travel from the sound generation 

25 point S to the sound reception point R. The composite 
sound ray intensity Ic indicates an intensity of the com- 
posite sound ray vector. The composite arrival direction 
indicates a direction of the synthesized sound ray when 
it reaches the sound reception point R. The composite 

so arrival direction is represented by a direction of the com- 
posite sound ray vector. 

[0052] The CPU 102 then, executes the following 
process to weight the composite sound ray intensity Ic 
of each composite sound ray vector found at step U6 
35 with the directivity and the direction at the sound recep- 
tion point R. That is to say, the CPU 102 retrieves the 
first record from the composite sound ray vector table 
TBL2 (step U8). 

[0053] The CPU 1 02 multiplies the record's composite 
40 sound ray intensity by a sound reception directivity at- 
tenuation coefficient g(fm, X, Y, Z) (step U9), and then 
overwrites a result to the corresponding composite 
sound ray intensity in the composite sound ray vector 
table TBL2. The sound reception directivity attenuation 
4S coefficient g(fm, X, Y, Z) corresponds to the directivity 
and the direction at the sound reception point R. 
[0054] in more detail, the sound reception point R pro- 
vides different sound reception sensitivities depending 
on directions. The sound reception directivity varies with 
so bands of the sound to be received. The CPU 102 cor- 
rects the directivity of the sound reception point R ac- 
cording to the direction at the sound reception point R 
to find the sound reception directivity attenuation coef- 
ficient g(fm, X, Y, Z). In accordance with the arrival di- 
ss rection of the composite sound ray vector toward the 
sound reception point R, the CPU 102 multiplies the 
sound reception directivity attenuation coefficient g(fm, 
X, Y, Z) and a sound ray vector intensity to find a com- 
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posite sound ray vector intensity corresponding to the 
directivity and direction of the sound reception point R. 
[0055] The CPU 102 then determines whether or not 
the record processed at step U9 is the last record in the 
composite sound ray vector table TBL2 (step 1)10). If 
the result is "NO", the CPU 1 02 retrieves the next record 
(step U11) and returns the process to step U9 to weight 
the composite sound ray intensity Ic for this record. 
[0056] If the result at step U1 0 is "YES", the CPU 1 02 
executes a process for each composite sound ray vector 
to determine which of four speakers 4 outputs a sound 
corresponding to the composite sound ray vector and 
assign this vector to each speaker. 4. Namely, the in- 
ventive reverberation applying apparatus has an output 
device that sounds the audio signal through a plurality 
of sounding channels spatially arranged to sound con- 
currently. Thus, the impulse response determination 
means determines a plurality of impulse responses in 
correspondence to the plurality of the sounding chan- 
nels based on the spatial arrangement of the sounding 
channels, and the convolution operation means convo- 
lves the audio signal with each of the impulse respons- 
es and feeds the respective convoluted audio signals to 
the respective sounding channels. 
[0057] More specifically, the CPU 102 retrieves the 
first record from the composite sound ray vector table 
TBL2 (step U12). According to the composite arrival di- 
rection, the CPU 102 determines which of the four 
speakers 4 should output a sound corresponding to the 
composite sound ray vector stored in the record, i.e., to 
which of the four reproduction channels the sound 
should be assigned. The CPU 102 adds the reproduc- 
tion channel information Indicative of this determination 
result to the record (step U13). For example, the com- 
posite arrival direction in the retrieved record may indi- 
cate arrival from the right front to the sound reception 
point R. In this case, the sound corresponding to the 
composite sound ray Vector needs to be output from the 
speaker 4-FR arranged to the right front of the listener 
U. For this purpose, the CPU 102 provides the repro- 
duction channel information indicative of the reproduc- 
tion channel corresponding to the speaker 4-FR' (see 
FIG. 9). When the arrival direction of the composite 
sound ray vector corresponds to the front, for example, 
it just needs to provide the reproduction channel infor- 
mation for generating the same sound volume from the 
speakers 4-FR and 4-FL as reproduction channels. 
[0058] The CPU 1 02 then determines whether or not 
the retrieved record is the last record in the composite 
sound ray vector table TBL2 (step U14). If the result is 
"NO", the CPU 102 retrieves the next record (step U15) 
and returns the process to step U13 to process this 
record. 

[0059] If the result at step U4 is "YES", the CPU 1 02 
increments the variable m by "1" (step .U16) and deter- 
mines whether or not the variable Is greaterthan a divi- 
sion count M for the frequency band (step U17). If the 
result is "NO", the CPU 1 02 returns the process to step 



U2 to find an impulse response for the next band. If the 
result at step U17 is "YES", the CPU 102 finds an im- 
pulse response for each reproduction channel from the 
composite sound ray intensity Ic found for each band 
s (step U 18).' 

[0060] More specifically, the CPU 1 02 references the 
reproduction channel information provided at step U13. 
The CPU 102 then extracts records for the composite 
sound ray vector assigned to the same reproduction 
10 channel from composite sound ray vector table TBL2 
generated for each band. The CPU 102 finds impulse 
. sounds collected at the sound reception point R on a 
time-series basis to specify an impulse response ac- 
cording to reverberation delay times and synthesized 
15 sound ray intensities of the extracted records. This 
specifies the impulse response for each reproduction 
channel. Namely, in the inventive reverberation applying 
apparatus, the impulse response determination means 
computes time intervals of the respective acoustic ray 
20 paths between the sound reception point and the sound 
generation point, and produces a time-series of the 
acoustic ray paths in terms of the computed time inter- 
vals, so that the weighed acoustic intensities of the 
acoustic ray paths determine a waveform of the Impulse 
25 response along a time axis.- 

[0061] Upon completion of the impulse response cal- 
culation process (step S6) 'as shown in FIG. 3, the CPU 
102 allows each of the convolution devices 116-1 
through 116-4 to perform a convolution operation be- 
30 tween the impulse response and the audio signal for ex- 
ecuting a process for reproducing the audio signal (step 
S7). That is to say, the CPU 102 outputs impulse re- 
sponses forthe reproduction channels corresponding to 
the convolution devices 116-1 through 116-4 and out- 
35 puts a command signal for performing a convolution op- 
eration between the impulse response and the audio, 
signal. . • 

[0062] Upon reception of the command signal from 
the CPU 102, the convolution devices 116-1 through 
40 1 1 6-4 receive the digital audio signal from the A/D con- 
, verier 1 1 4 and perform a convolution operation between 
the audio signal and the impulse response received 
from the CPU 102. FIG. 1 0 schematically shows a con- 
volution operation processing block for the convolution 
45 devices 116-1 through 116-4. As shown in FIG. 10, the 
convolution operation processing block comprises 
many delay circuits 1160, multiplier circuits 1162, and' 
adder circuits 1164. The delay circuit 1160 provides an 
audio signal with a given time delay. The multiplier circuit 
so 1 1 62 multiplies the audio signal and a coefficient corre- 
sponding to each pulse for the impulse response re- 
ceived from the CPU 102..The adder circuit 11 64. adds 
audio signals to each other output from the multiplier cir- 
cuits 1162. Inthisconfiguration, reverberantsoundcom- 
55 ponents corresponding to one impulse response are 
generated in such a mannerthat the audio signal passes 
the number of delay circuits 1160 corresponding to the 
reverberation delay time and also passes the multiplier 
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circuits 1162 corresponding to the impulse response. 
The convolution operation processing block adds the re- 
verberant soundcomponents to provide the audio signal 
with the reverberation effect. 

[0063] The convolution devices 116-1 through 116-4 
then output the operation results to the DSPs 118-1 
through 118-4, respectively. The DSPs 118-1 through 
118*1 apply various signal processes to the received 
digital audio signal and outputthe signal to the D/A con- 
verters 120-1 through 120-4, respectively. The D/A con- 
verter 120-1 through 1 20-4 convert the received digital 
audio signal into an analog audio signal and output it to 
the corresponding speakers 4. The respective speakers 
4 output sounds corresponding to the received audio 
signal. 

[0064] The composite sound ray intensity of the com- 
posite sound ray vector is found in accordance with four 
elements, i.e., the directivity and the direction at the 
sound generation point S and the directivity and the di- 
rection at the sound reception point R. The composite 
sound ray vector specifies an impulse responsefor each 
reproduction channel. That is to say, the specified im- 
pulse response reflect four elements. The impulse re- 
sponse is convoluted with the audio signal, reproducing 
an audio signal acquired as a convolution operation re- 
sult. When the reverberation applying apparatus 10 re- 
produces an audio signal of the musical sound, it repro- 
duces states of listening to the musical sound performed 
on the stage at a seat in the audience including musical 
instruments' directivity and performers' directions. In 
other words, the reproduced acoustic field represents 
differences between musical instruments having differ- 
ent directivity such as a trumpet, a violin, a.flute, and a 
piano. Further, differences in performance conditions 
are expressed in such a manner that the sound strongly 
reflects on a wall when the performer plays facing the 
wall; it weakly reflects on the wall when the performer 
plays with his or her back to the wall. As mentioned 
above, the reverberation applying apparatus 1 0 accord- 
ing to the embodiment can accurately reproduce the 
acoustic field. 

[0065] The reverberation applying apparatus 10 ac- 
cording to the embodiment can always provide acoustic 
ray paths equal to each other acquired as a result of the 
acoustic ray path estimation at step S4 (see FIG. 3) if 
no change is made to arrangement positions among the 
acoustic space, the sound generation point S, and the 
sound reception point R, When the storage device 108 
or the like stores the estimated acoustic ray paths, the 
acoustic ray path estimation at step S4 need not be re- 
executed if a change is made to information other than 
the arrangement positions among the acoustic space, 
the sound generation point S, and the sound reception 
point R. This makes it possible to shorten the process 
time until the impulse response is specified. The embod- 
iment has exemplif ied the reverberant sound supply ap- 
paratus configured to reproduce sounds in an acoustic 
space by generating an impulse response and using the 



impulse response to output sounds. Further, it may be 
preferable to configure different apparatuses for gener- 
ating an impulse response and supplying a reverberant 
sound in such a manner that the impulse response gen- 

s eratlon apparatus generates an impulse response and 
the reverberation applying apparatus provides a rever- 
berant sound using the impulse response. The embod- 
iment may be configured so that either the sound gen- 
eration point S or the sound reception point R provides 

'0 uniform directivity, i.e., nondirectional characteristics. It- 
may be preferable to use only the directional directivity 
for weighting. 

<Modifications> 

[0066] The above-mentioned embodiment just shows 
a form of the present invention. It is further understood 
by those skilled in the art that various changes and mod- 
ifications may be made in the present invention without 
20 departing from the spirit and scope thereof. The follow- 
ing describes various modifications of the embodiment. 

(Modification 1) 

25 [0067] While the reverberation applying apparatus 1 0 
according to the above-mentioned embodiment has four 
reproduction channels, it is optional as to the numberof 
reproduction channels to be provided. While the embod- 
iment uses the XYZ orthogonal coordinate system for 

so describing various types of coordinate information, any 
coordinate systems may be used. 

(Modification 2) 

as [0068] According to the above-mentioned embodi- 
ment, :the storage device 108 in. the reverberation ap- 
plying apparatus 10 previously stores a plurality of re- 
production acoustic space data corresponding to acous- 
tic spaces such as a concert hall. A user selects an 

40 acoustic space to be reproduced out of the stored 
acoustic spaces. The present invention is not limited 
thereto. The embodiment may be modified so that the 
user can design any acoustic space and the reverbera- 
tion applying apparatus 10 can provide the audio signal 

45 with a reverberation effect of the designed acoustic 
space. Further, the embodiment may be modified so that 
the user can freely adjust directivity of the sound gener- 
ation point S and the sound reception point R. Namely, 
the inventive reverberation applying apparatus has a 

so display device that displays the selected acoustic 
space, such that the user can operate the input device 
to visually modify the spatial shape of the selected 
acoustic space on the display device and to set either 
of the sound generation point and the sound reception 

55 point in the acoustic space. 
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(Modification 3) 

[0069] While the above-mentioned embodiment pro- 
vides only one sound generation point S, the present 
Invention is not limited thereto. The embodiment may 
be modified so that a plurality of sound generation points 
S is provided. Moreover, the embodiment may be mod- 
ified so that a plurality of sound reception points R is 
provided. When there are provided a plurality of sound 
generation points S and a plurality of sound reception 
points R, the CPU 102, at step S4 in FIG. 3, estimates 
an acoustic ray path traveled by an impulse sound from 
one sound generation point S up to each sound recep- 
tion point R for each sound generation point S. 3. Name- 
ly, in the inventive reverberation applying apparatus, the 
point information acquisition means acquires the point 
information indicating that either of the sound genera- 
tion point and the sound reception point are set multiple, 
and the acoustic ray path estimation means estimates 
each set of acoustic ray paths of the sound traveling 
from each sound generation point to each sound recep- 
tion point, so that the impulse response determination 
means determines a total impulse response of the 
acoustic space involving a multiple of the sound gener- 
ation points or a multiple of the sound reception points. 

(Modification 4) 

[0070] According to the above-mentioned embodi- 
ment, the sound generation point S is fixed to the ar- 
ranged position and direction. Furthermore, the embod- 
iment may be modified so that the reverberation apply- 
ing apparatus 10 finds an Impulse response in accord- 
ance with changes in the arrangement position and di- 
rection of the sound generation point S. This modifica- 
tion reproduces an acoustic field in which, for example, 
a performer moves on the stage by playing a musical 
instrument. Namely, in the inventive reverberation ap- 
plying apparatus, the point information acquisition 
means periodically acquires the point information while 
either of the sound generation point and the sound re- 
ception point may move in the acoustic space, and the 
acoustic ray path estimation means updates the acous- 
tic ray paths of the sound traveling from the sound gen- 
eration point to the sound reception point each time the 
point information is acquired, so that the impulse re- 
sponse determination means re-determines the impulse 
response each time the acoustic ray paths are updated 
for dynamic reproduction of the sound responsive to 
movement of either of the sound generation point and 
the sound reception point. 

[0071] As mentioned above, the present invention 
provides the reverberation applying apparatus, the re- 
verberation applying method, the impulse response 
generation apparatus, the impulse response generation 
method, the reverberation applying program, the im- 
pulse response generation program, and the recording 
medium capable .for more accurately reproducing 



acoustic. fields in the acoustic space. 



1 . A reverberation applying apparatus for applying a 
reverberation effect to an audio signal for reproduc- 
tion of a sound in a desired acoustic space, the ap- 
paratus comprising: 

10 * 

a space information acquisition means for ac- 
quiring space information indicating a spatial 
shape of the acoustic space bordered by a 
boundary surface and an acoustic reflectivity of 
15 the boundary surface enclosing the acoustic 

space; 

a point information acquisition means for ac- 
quiring point information indicating positions of 
a sound generation point set in the acoustic 
20 space as a point of generating the sound, and 

a sound reception point set in the acoustic 
space as a point of receiving the sound; 
an acoustic ray path estimation means for es- 
timating a set of acoustic ray paths of the sound 
25 traveling from the sound generation pointfo the 

sound reception point through the acoustic 
space based on the acquired space information 
and the point information; 
a directivity information acquisition means for 
30 acquiring directivity information indicating ei- 

ther of an acoustic generation directivity char- 
acterizing a directivity of the sound generation 
point In generating the sound; and an acoustic 
reception directivity characterizing a directivity 
35 of the sound reception point in receiving the 

sound; 

a weighting means for estimating each acoustic 
intensity of the sound around the sound recep- 
tion point for each of the acoustic ray paths 

40 through which the sound travels to the sound 

reception point from the sound generation 
point, andfor weighting each acoustic intensity 
by the acquired directivity information; 
an impulse response determination means for 

45 determining an impulse response of the acous- 

tic space based on directions of the respective 
acoustic ray paths toward the sound reception 
point and the weighed acoustic intensities of 
the respective acoustic ray paths; and 

50 a convolution operation means for performing 

a convolution operation between the deter- 
mined impulse response and the audio signal 
to apply thereto the reverberation effect specific 
to the acoustic space. 

55 

2. The reverberation applying apparatus according to 
claim 1 , wherein the point information acquisition 
means periodically acquires the point information 
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while either- of the sound generation point and the 
sound reception point may move in the acoustic 
space, and the acoustic ray path estimation means 
updates the acoustic . ray paths of the sound 
traveling from the sound generation point to the s 
sound reception point each time the point informa- 
tion is acquired, so that the impulse response de- 
termination means re-determines the impulse re- 
sponse each time the acoustic ray paths are updat- 
ed for dynamic reproduction of the sound respon- 10 
sive to movement of either of the sound generation 
point and the sound reception . point. ■ 

3. The reverberation applying apparatus according to 
claim 1 , wherein the point information acquisition 15 
means acquires the point information indicating that 
either of the sound generation point and the sound 
reception point are set mu ltiple, and the acoustic ray 
path estimation means estimates each set of 
acoustic ray paths of the sound traveling from each 20 

■ sound generation point to each sound reception 
point, so that the impulse response determination 
means determines a total impulse response of the 
acoustic space involving a multiple of the sound 
generation points or a multiple of the sound recep- 25 
tion points. 

4. The reverberation applying apparatus according to 
claim 1 , further comprising an output means for 
sounding the audio signal through a plurality of 30 
sounding channels spatially arranged to sound con- 
currently, wherein the impulse response determina- 
tion means determines a plurality of impulse re- 
sponses in correspondence to the plurality of the 
sounding channels based on the spatial arrange- 35 
ment of the sounding channels, and the convolution 
operation means convolutes the audio signal with 
each of the impulse responses and feeds the re- 
spective convoluted audio signals to the respective 
sounding channels. 40 

5. The reverberation applying apparatus according to 
claim 1, further comprising a storage means for 
storing a plurality of the space information repre- 
senting a plurality of acoustic spaces of different 45 
types, and an input means operable by a user to 
select a desired one of the acoustic spaces, where- 
in the space information acquisition means re- 
trieves the space information corresponding to the 
selected acoustic space from the storage means. so 

6. The reverberation applying apparatus according to 
claim 5, furthercomprising a display means for dis- 
playing the selected acoustic space, such that the 
user can operate the input means to visually modify 55 
the spatial shape of the selected acoustic space on 

the display means and to set either of the sound 
generation point and the sound reception point in 



the acoustic space. 

7. The reverberation applying apparatus according to 
claim 1 , wherein the impulse response determina- 
tion means computes time intervals of the respec- 
tive acoustic ray paths between the sound reception 
point and the sound generation point; and produces 
a time-series of the acoustic ray paths in terms of 
the computed time intervals, so that the weighed 
acoustic intensities of the acoustic ray paths deter- 
mine a waveform of the impulse response along a 
time axis. 

8. An impulse response determining apparatus capa- 
ble of determining an impulse response for use in 
reproduction of a sound in a desired acoustic space, 
the apparatus comprising: 

a space information acquisition means for ac- 
quiring space information indicating a spatial 
shape of the acoustic space bordered by a. 
boundary surface and an acoustic reflectivity of 
the boundary surface enclosing the acoustic 
space; ■ 

a point information acquisition means for ac- 
quiring.point information indicating positions of 
a sound generation point set in the acoustic 
space as a point of generating the sound, and 
a sound reception point set in the acoustic 
space as a point of receiving the sound; 
an acoustic ray path estimation means for es- 
timating a set of acoustic ray paths of the sound 
traveling from the sound generation polnttothe 
sound reception point through the acoustic 
space based on the acquired space information 
and the point information; 
a directivity information acquisition means for 
acquiring directivity information indicating ei- 
ther of an acoustic generation directivity char- 
acterizing a directivity of the sound generation 
point in generating the sound, and an acoustic 
reception directivity characterizing a directivity 
of the sound reception point in receiving the 
sound; 

a weighting means for estimating each acoustic 
intensity of the sound around the sound recep- 
tion point for each of the acoustic ray paths 
through which the sound travels to the sound 
reception point from the sound generation 
point, and for weighting each acoustic intensity 
by the acquired directivity information; and 
an impulse response determination means for 
determining an impulse response of the acous- 
tic space based on directions of the respective 
acoustic ray paths toward the sound reception 
point and the weighed acoustic intensities of 
the respective acoustic ray paths. . 
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9. A reverberation applying method of applying a re- 
verberation effect, to an audio signal for reproduc- 
tion of a sound in a desired acoustic space, the 
method comprising: 

a first step of acquiring space information and 
point information, the space information indi- 
cating a spatial shape of the acoustic space 
bordered by a boundary surface and an acous-. 
tic reflectivity of the boundary surface enclosing 
the acoustic space, the point information indi- 
cating positions of a sound generation point set 
in the acoustic space as a point of generating 
the sound and a sound reception point set in 
the acoustic space as a point of receiving the 
sound; 

a second step of estimating a set of acoustic 
ray paths of the sound traveling from the sound 
generation, point to the sound reception point 
through the acoustic space based on the ac- 
quired space information and the point informa- 
tion; 

a third step of acquiring directivity information 
indicating either of an acoustic generation di- 
rectivity characterizing a directivity of the sound 
generation point in generating the sound, and 
an acoustic reception directivity characterizing 
a directivity of the sound reception point in re- 
ceiving the sound; 

a fourth step of estimating each acoustic inten- 
sity of the sound around the sound reception 
point for each of the acoustic ray paths through 
which the sound travels to the sound reception 
point from the sound generation point, and 
weighting each acoustic intensity by the ac- 
quired directivity information; 
a fifth step of determining an impulse response 
of the acoustic space based on directions of the 
respective acoustic ray paths toward the sound 
reception point and the weighed acoustic inten- 
sities of the respective acoustic ray paths; and 
a sixth step of performing a convolution opera- 
tion between the determined impulse response 
and the audio signal to apply thereto the rever- 
beration effect specific to the acoustic space. 

10. An impulse response determining method of deter- 
mining an impulse response for use in reproduction 
of a sound in a desired acoustic space, the method 
comprising: 

a first step of acquiring space information and 
point information, the space information indi- 
cating a spatial shape of the acoustic space 
bordered by a boundary surface and an acous- 
tic reflectivity of the boundary surface enclosing 
the acoustic space, the point information Indi- 
cating positions of a sound generation point set 



in the acoustic space as a point of generating 
the sound and a sound reception point set in 
the acoustic space as a point of receiving the 
sound; 

s a second step of estimating a set of acoustic 

ray paths of the sound traveling from the sound 
generation point to the sound reception point 
through the acoustic space based on the ac- 
quired space information and the point informa- 

10 tion; 

a third step of acquiring directivity information 
indicating either of an acoustic generation di- 
rectivity characterizing a directivity of the sound 
generation point in generating the sound, and 

15 an acoustic reception directivity characterizing 

a directivity of the sound reception point in re- 
ceiving the sound; 

a fourth step of estimating each acoustic inten- 
sity of the sound around the sound reception 

20 point for each of the acoustic ray paths through 

which the sound travels to the sound reception 
point from the sound generation point, and 
weighting each acoustic intensity by the ac- 
quired directivity information; and 

25 a fifth step of determining an impulse response 

of the acoustic space based on directions of the 
respective acoustic ray paths toward the sound 
reception point and the weighed acoustic inten- 
sities of the respective acoustic ray paths. 

1.1 . A computer program for use in a reverberation ap- 
plying apparatus having a CPU, the program being 
executable by the CPU for causing the reverbera- 
tion applying apparatus to perform a method of ap- 
35 plying a reverberation effect to an audio signal for 
reproduction of a sound in a desired acoustic space, 
wherein the method comprises: 

a first step of acquiring space information and 
40 point information, the space information indi- 

cating a spatial shape of the acoustic space 
bordered by a boundary surface and an acous- 
. tic reflectivity of the boundary surface enclosing 
the acoustic space, the point information indi- 
es eating positions of a sound generation point set 
in the acoustic space as a point of generating 
the sound and a sound reception point set in 
the acoustic space as a point of receiving the 
sound; 

50 a second step of estimating a set of acoustic 

ray paths of the sound traveling from the sound 
generation point to the sound reception point 
through the acoustic space based on the ac- 
quired space information and the point informa- 

55 tion; 

a third step of acquiring directivity information 
indicating either of an acoustic generation di- 
rectivity characterizing a directivity of the sound 
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generation point in generating the sound, and 
an acoustic reception directivity characterizing 
a directivity of the sound reception point in re- 
ceiving the sound; 

a fourth step of estimating each acoustic Inten- s 
sity of the sound around the sound reception 
point for each of the acoustic ray paths through 
which the sound travels to the sound reception 
point from the sound generation point, and 
weighting each acoustic intensity by the ac- 10 
quired directivity information; 
a fifth step of determining an impulse response 
of the acoustic space based on directions of the 
respective acoustic ray paths toward the sound 
reception point and the weighed acoustic inten- 15 
sities of the respective acoustic ray paths; and 
a sixth step of performing a convolution opera- 
tion between the determined impulse response 
and the audio signalto apply thereto the rever- 
beration effect specific to the acoustic space. 20 

A computer program for use in an impulse, response 
determining apparatus having a CPU, the program 
being executable by the CPU for causing the im- 
< pulse response determining apparatus to perform a 25 
method of determining an impulse response for use 
in reproduction of a sound in a desired acoustic 
space, wherein the method comprises: 

a first step of acquiring space information and so 
point information, the space information indi- 
cating a spatial shape of the acoustic space 
bordered by a boundary surface and an acous- 
tic reflectivity of the boundary surf ace encloslng 
the acoustic space, the point information indi- 35 
eating positions of a sound generation point set 
in the acoustic space as a point of generating 
the sound and a sound reception point set in 
the acoustic space as a point of receiving the 
sound; 40 
a second step of estimating a set of acoustic 
ray paths of the sound traveling from the sound 
generation point to the sound reception point 
through the acoustic space based on the ac- 
quired space information and the point informa- 45 
tion; 

a third, step of acquiring directivity information 
indicating either of an acoustic generation di- 
rectivity characterizing a directivity of the sound 
generation point in generating the sound, and so 
an acoustic reception directivity characterizing 
a directivity of the sound reception point in re- 
ceiving the sound; 

a fourth step of estimating each acoustic inten- 
sity of the sound around the sound reception 55 
point for each of the acoustic ray paths through 
which the sound travels to the sound reception 
point from the sound generation point, and 



weighting each acoustic intensity by the ac- 
quired directivity information; and 
a fifth step of determining an impulse response 
of the acoustic space based on directions of the 
respective acoustic ray paths toward the sound 
reception point and the weighed acoustic inten- 
sities of the respective acoustic ray paths. 

13. A machine readable medium for use in a reverber- 
ation applying apparatus having a CPU, the medi- 
um containing a program executable by the CPU 
for causing the reverberation applying apparatus to 
perform a method of applying a reverberation effect 
to an audio signal for reproduction of a sound in a 
desired acoustic space, Wherein the method com- 
prises: 

a first step of acquiring space information and 
point information, the space information indi- 
cating a spatial shape of the acoustic space 
bordered by a boundary surface and an acous- 
tic reflectivity of the boundary surface enclosing 
the acoustic space, the point information indi- 
cating positions of a sound generation point set 
in the acoustic space as a point of generating 
the sound and a sound reception point set in 
the acoustic space as a point of receiving the 
sound; 

, a second step of estimating a set of acoustic 
ray paths of the sound traveling from the sound 
generation point to the sound reception point 
through the acoustic space based on the ac- 
quired space information and the point informa- 
tion; 

a third step of acquiring directivity information 
indicating either of an acoustic generation di- 
rectivity characterizing a directivity of the sound 
generation point in generating the sound, and 
an acoustic reception directivity characterizing 
a directivity of the sound reception point in re- 
ceiving the sound; 

a fourth step of estimating each acoustic inten- 
sity of the sound around the sound reception 
point for each of the acoustic ray paths through 
which the sound travels to the sound reception 
point from the sound generation point, and 
weighting each acoustic intensity by the ac- 
quired directivity information; 
a fifth step of determining an impulse response 
of the acoustic space based on directions of the 
respective acoustic ray paths toward the sound 
reception point and the weighed acoustic inten- 
sities of the respective acoustic ray paths; and 
a sixth step of performing a convolution opera- 
tion between the determined impulse response 
and the audio signal to apply thereto the rever- 
beration effect specific to the acoustic space. 



13 



25 



EP 1 357 536 A2 



14. A machine readable medium for use in an impulse 
response determining apparatus having a CPU, the 
medium containing a program executable by the 
CPU for causing the impulse response determining 
apparatus to perform a method of determining an s 
impulse response for use in reproduction of a sound 
in a desired acoustic space, wherein the method 
comprises: 

a first step of acquiring space information and 10 
point information, the space information indi- 
cating a spatial shape of the acoustic space 
bordered by a boundary surface and an acous- 
tic reflectivity of the boundary surface enclosing 
the acoustic space, the point information indi- is 
eating positions of a sound generation point set 
in the acoustic space as a point of generating 
the sound and a sound reception point set in 
the acoustic space as a point of receiving the 
sound; 20 
a second step of estimating a set of acoustic 
ray paths of the sound traveling from the sound 
generation point to the sound reception point 
through the acoustic space based on the ac- 
quired space information and the point informa- 25 
tion; 

a third step of acquiring directivity information 
indicating either of an acoustic generation di- 
rectivity characterizing a directivity of the sound 
generation point in generating the sound, and 30 
an acoustic reception directivity characterizing 
a directivity of the sound reception point in re- 
ceiving the sound; 

a fourth step of estimating each acoustic inten- 
sity of the sound around the sound reception 35 
point for each of the acoustic ray paths through 
which the sound travels to the sound reception 
point from the sound generation point, and 
weighting each acoustic intensity by the ac- 
quired directivity information; and 40 
a fifth step of determining an impulse response 
of the acoustic space based on directions of the 
respective acoustic ray paths toward the sound ■ 
reception point and the weighed acoustic inten- 
sities of the respective acoustic ray paths. 45 
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